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Abstract 

This quasi-experimental study aims to investigate the documentary films' influence on 8th grade students’ 
nature of science views. The study’s participants were 113 8th grade students from two different schools taught 
by two different teachers. The study was completed over a 6-week period, during which topics related to "Cell 
Division and Heredity” and "Force and Motion” were covered. In the experimental group, six documentary 
films were integrated into the science curriculum to teach ideas about nature of science. The control group, 
however, followed the regular science curriculum. The Views of Nature of Science Elementary Level (VNOS-E) 
questionnaire developed by Lederman and Ko (2004) was used as the data collection tool. In addition, semi- 
structured interviews were conducted with 28 students using the VNOS-E questionnaire at the beginning and end 
of the study. The results suggest that students in the control group showed no significant improvement in their 
understanding about nature of science in response to the instruction.However, students in the experimental 
group showed statistically improvements in their understanding about four of the five nature of science themes 
in response to the instruction. In addition, a statistically significant difference was found between the views 
of the experimental group and those of the control group students in the post-test results for four of the five 
nature of science themes. The results suggest that the use of documentary films in science classrooms has the 
potential to enhance students’ views about nature of science. 
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Cultivating engaged and scientifically literate 
citizens is defined as one of the main objectives of 
several science curricula and policy documents; 
namely, the American Association for the 
Advancement of Science [AAAS], 1990; the 
National Research Council [NRC], 1996; the NGSS 
Lead States, 2013; Nuffield Twenty First Century 
Science, 2007; and in the Turkish Science and 
Technology Education Curriculum (Milli Egitim 
Bakanligi [MEB], 2005, 2013). Understanding 
nature of science is seen as an essential and 
critical component of scientific literacy in these 
documents and curricula (Lederman, 2007). The 
phrase, nature of science, usually is used to refer 
to “the epistemology and sociology of science, 
science as a way of knowing, or the values and 
beliefs inherent to scientific knowledge and its 
development” (Lederman, Abd-El-Khalick, Bell 8c 
Schwartz, 2002, p. 498). In the literature in most 
cases the phrase nature of science has been used 
to refer to nature of scientific knowledge or the 
phrase nature of science and nature of scientific 
knowledge have been used interchangeably; 
nonetheless, they are quite different (Hodson, 
2014). That has caused some misunderstanding; 
therefore, in this paper NOS refers to nature of 
scientific knowledge (Lederman, Antink, 8c Bartos, 
2014). Although there is no single and universally 
accepted definition of NOS (Erduran 8c Dagher, 
2014) at present significant academic consensus 
has been achieved on which aspects of NOS are to 
be taught in school science classes (Lederman et al., 
2002; Smith, Lederman, Bell, McComas, 8c Clough, 
1997; Smith 8c Scharman, 1999). These aspects 
include teaching students that scientific knowledge, 
its “facts,” “theories,” and “laws” are both reliable 
and tentative (NOS-1), empirically based (based 
on and/or derived from observations of the natural 
world) (NOS-2), subjective and/or theory-laden 
(NOS-3), partly the product of human imagination 
and creativity (NOS-4), subject to a distinction 
between observations and inferences (NOS-5), 
influenced by social and cultural factors (NOS- 
6), and that theories and laws are different kinds 
of knowledge (NOS-7) (Lederman, 1992, 2007). 
It was suggested that the first five aspects (NOS- 
1-5) would be suitable for middle school students 
(Akerson, Abd-El-Khalick, 8c Lederman, 2000; 
Akerson 8c Donnelly, 2010; Parker, 2010). Since 
these five aspects are also the main focus of the 
Turkish science curriculum (MEB, 2005,2013), this 
study focuses on them. The results of performing an 
intensive study on students, teachers, and scientists’ 
views on NOS show that the greater majority of 


them hold a variety of naive views toward NOS 
(Aydeniz, Baksa, 8c Skinner, 2011; Cakmakci, 
2012; Lederman, 2007; McComas, 1998; Schwartz, 
Lederman, 8c Crawford, 2004). Therefore, strategies 
that encourage students and teachers to understand 
NOS have become desirable. Generally speaking, 
researchers have used either an implicit or explicit 
approach in their attempts to enhance students’ 
and teachers’ views regarding NOS (Akerson 8c 
Donnelly, 2010; Akerson et al., 2000; Khishfe 8c 
Abd-El-Khalick, 2002; Parker, 2010). Recently, 
reflective elements have also been given prominence 
within the explicit approach (Lederman, 2007) 
with several researchers having proposed that 
using an explicit-reflective approach to develop 
students’ NOS views was more effective than an 
implicit approach (Cakmakci, 2012; Kaya, 2011; 
Khishfe 8c Abd-El-Khalick, 2002; Kii^iik, 2006). 
In this study, an explicit-reflective instruction of 
NOS was used as a pedagogical framework in the 
context of documentary films. Using scenes from 
thought-provoking documentary films can offer a 
context-oriented learning environment (Clough, 
2006; Guerra-Ramos, Ryder, 8c Leach, 2010; 
Lederman et al., 2014) that can be used to explicitly 
discuss historical processes and practices that have 
advanced scientific and technological knowledge 
(Blasco, Moreto, Roncoletta, Levites, 8c Janaudis, 
2006; Dark, 2005; Efthimiou 8c Llewellyn, 2006, 
2007; Ozta§, 2008; Piliouras, Siakas, 8c Seroglou, 
2011; Rose, 2003; Weber 8c Silk, 2007). It has been 
suggested that explicit-reflective NOS instruction 
would be more effective if more context-specific 
activities were used during actual instruction 
(Duschl 8c Grandy, 2013; Guerra-Ramos et al., 
2010). Many people intentionally or unintentionally 
use television, Internet, or newspapers more than 
any other medium as their primary source of 
information about science and technology. While 
the value of popular media in science education has 
been acknowledged, very little empirical research 
and guidance exists helping teachers to incorporate 
such mediums into the science curriculum nor in 
helping teachers to effectively use these mediums 
in their classroom practice (Cakmakci 8c Yalaki, 
2012; Kuzma, 2001; Luis Alvarez, Miller, Levy, 8c 
Svejenova, 2004). This quasi-experimental study 
aims to investigate the documentary films’ influence 
on 8 th grade students’ NOS views. The current study 
aims to address the following research questions: 

• What are the differences in control group 
students’ views on NOS before and after the 
instruction? 
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• What are the differences in experimental group 
students’ views on NOS before and after the 
instruction? 

• What are the differences between control and 
experimental group students’ views on NOS after 
the instruction? 

Method 

Design of the Study 

A quasi-experimental design with a non-equivalent 
pre-test-post-test control group was used in this study. 
In this design, two 8 th grade groups were selected as 
experimental groups, whereas the other two were 
selected as control groups. The study’s dependent 
variable was students’ views about NOS, whereas the 
independent variable was science lessons. 

In the literature, since long-term intervention seems 
to be more effective in teaching NOS (Akerson & 
Donnelly, 2010; Khishfe, 2008; Khishfe & Abd-El- 
Khalick, 2002; Kii^iik, 2006), the present study was 
conducted over a six-week period. Documentary 
films on the topics “Cell Division and Heredity” and 
“Force and Motion” were used. Alternative concepts 
within these two fields were also considered while 
designing instruction (Akyurek & Afacan, 2012; 
Aydin & Balim, 2013; Beichner, 1996; Demir & Sezek, 
2009; Eryilmaz, 2002; Kilin<;, 2008; Yilmaz, 2007; Yip, 
1998). The key assumption behind this study is that 
explicitly teaching crucial aspects of NOS through 
documentary films and placing more emphasis on 
the areas of NOS which students find difficult, can 
improve students’ understanding of NOS. 

Sampling 

This study was conducted in two middle schools, 
located in Eski§ehir, Turkey during the fall semester 
of the 2012-2013 academic year. A total of 113 8 th 
grade students (57 from the experimental groups 
[EG] and 56 from the control groups [CG]) from 
four classes, all of whom were taking the compulsory 
science and technology course , participated in the 
study. There was no significant difference between 
the two groups’ level of achievement in the science 
and technology course that they had taken the 
previous year (t (109) = 1.932, p > .05). Accordingly, 
two of the classes were randomly selected to be 
the EG. Both groups were instructed for an equal 
amount of instructional time. 


Intervention 

A pilot study was conducted in a middle school in 
Eski§ehir, Turkey during the unit on Cell Division 
and Heredity of the 8 th grade Science and Technology 
course. In the pilot study, scenes from Charles Darwin 
and the Tree of Life (Malick, 2009) documentary were 
used to teach natural selection, adaptation, and the 
theory of evolution. Based on the pilot study, materials 
for the main study were modified. Two middle schools 
from Eski§ehir were selected for the main study, 
the nature of which was introduced to the teachers 
whose views regarding the instruction process were 
taken into account during its modification. During 
the Cell Division and Heredity unit; scenes from 
Science and Life-Mendel (Erdem & Ozdemir, 2007a), 
Science and Life-DNA (Erdem & Ozdemir, 2007b), 
and Charles Darwin and the Tree of Life (Malick, 
2009) documentary films were used in the EG while 
introducing such concepts as heredity, DNA, the 
genetic code, adaptation, and evolution. For the Force 
and Motion unit, Archimedes (Erdem and Ozdemir, 
2007c), the Wright Brothers: How was the Plane 
Invented? (Erdem and Ozdemir, 2007d) and First 
Flying Tests (Markham, 2001) documentary films 
were shown to the students in the experimental group 
during instruction on the buoyancy of gases and 
liquids. Before starting the documentary, the teacher 
simply advised students to carefully watch it, giving no 
further instruction. For short documentaries [around 
5 minutes], the teacher allowed the students to 
watch the whole documentary, before soliciting their 
comments. For the longer documentaries [around 14 
minutes] on the other hand, the teacher would stop 
the documentary to discuss and clarify those issues 
that were not understood by students. After watching 
the documentary, the teacher explicitly discussed the 
concepts included in the documentary and themes 
related to NOS. The teacher first asked which concepts 
had been covered in the documentary and which 
scientists had been discussed. He/she then asked 
students for their opinions about the film. Toward the 
end of the lesson, the teacher distributed discussion 
questions specifically prepared for each documentary 
to students, providing them with sufficient time 
to write their responses. A sheet, summarizing 
the documentary and the issues discussed in the 
classroom, were distributed to the students at the end 
of the lecture in which NOS themes were emphasized. 

The same teachers instructed the control and 
experimental groups. The first author observed 
both experimental and control groups, monitoring 
the whole process throughout the study. The 
Views of the Nature of Science-Elementary Level 
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(VNOS-E) questionnaire was applied as a pre- and 
post-test. In addition, semi-structured interviews 
were conducted with 28 students by using the 
questions in the VNOS-E questionnaire. Table 1 
summarizes the design of the study. 


Table 1 

The Design of the Study 



Group 

Pre-test 

Application 

Post-test 


VNOS-E ques- 

Instruction as 

VNOS-E 


tionnaire was 

recommended 

question- 


used in conjunc- 

by the science 

naire was 


tion with individ- 

and technology 

used in 


ual interviews 

curriculum 

conjunc- 



and the use of 

tion with 

0) 

<u 

M 

W 


documentary 

individual 


films associ¬ 
ated with the 
desired gains 
of the science 
and technology 
curriculum 

interviews 


VNOS-E ques- 

Instruction as 

VNOS-E 


tionnaire was 

recommended 

question- 

U 

used in conjunc- 

by the science 

naire was 

o 

tion with individ- 

and technology 

used in 

q 

o 

U 

ual interviews 

curriculum 

conjunc¬ 
tion with 
individual 
interviews 


Data Collection Instruments 

VNOS-E Questionnaire: VNOS- E developed by 
Lederman and Ko (2004) was preferred because it 
was appropriate for elementary level and because it 
had been adopted into Turkish and used by other 
researchers (Demir 8c Akarsu, 2013; Erenoglu, 
2010). The questionnaire consists of seven open- 
ended questions. The VNOS-E and VNOS-D 
questionnaires have similar questions (Lederman 
et al., 2002; Metin 8c Leblebicioglu, 2012). NOS 
themes included in the VNOS-E are summarized in 
Table 2 (Akerson 8c Donnelly, 2010; Parker, 2010). 
Prior to the implementation of the questionnaire, 
experts compared the Turkish and English versions 
of the questionnaire to ensure linguistic validity. 
The VNOS-E Questionnaire has been applied to 
the students of the EG and CG one week prior to 


watching the documentaries as a pre-test, and one 
week after watching them as a post-test. 

Semi-structured Interview: Lederman et al. 
(2002) advised conducting interviews with all 
or 15-20% of the students after completing the 
VNOS questionnaire. The VNOS-E questionnaire 
was used during the semi-structured interviews 
conducted both before and after the instruction in 
order to increase the validity of the study, to reveal 
deeper meanings that the students have assigned 
to NOS s features, and to determine their thoughts 
about the activities. 

Face-to-face interviews were conducted with a sub¬ 
sample of the students (N = 28) before and after the 
lessons instruction. After the implementation of 
the VNOS-E questionnaire, 2 students with a good, 
3 with a moderate, and 2 with a low understanding 
level of NOS were interviewed in each classroom. 
The selection process was held in the same way for 
both the EG and the CG. Interviews were audio- 
recorded and transcribed for analysis. 

Data Analysis 

VNOS-E Questionnaire: A coding scheme 
developed by Lederman et al. (2002) was used to 
analyze the data. Students’ views about NOS were 
classified as “Naive,” “Has Merit,” and “Informed.” 
Detailed examples of these coding categories 
are described in the results section. Students’ 
interview responses were analyzed, and each 
individual participant’s responses to the VNOS-E 
questionnaire were compared to his/her responses 
in the more open interview context in order to 
assess the consistency of the participant’s responses. 
In order to ensure the reliability of the analysis, the 
researchers performed an inter-coder reliability 
test on the coding. The Cohen Kappa coefficient 
was checked in order to calculate the reliability of 
comparative agreement between the two evaluators. 


Table 2 

NOS Themes Included in the VNOS-E Questionnaire 


Questions Included in 

the VNOS-E Questionnaire 

NOS Themes 

i 

2 

3 

4 

5 

6 7 

Scientific knowledge is reliable but is subject to change (NOS-1) 

✓ 


✓ 

✓ 


✓ 

Scientific knowledge is empirically-based (NOS-2) 

✓ 

✓ 





Scientific knowledge is subjective (NOS-3) 

✓ 




✓ 


Human imagination and creativity play an important role on the produc¬ 
tion of scientific knowledge (NOS-4) 

✓ 



✓ 


✓ 

Observations and inferences are different (NOS-5) 

✓ 



✓ 


✓ 
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Semi-structured Interviews: During the analysis, 
the records of the interviews conducted with 28 
students (14 from each school) were listened to 
and transcribed. The data obtained from the EG 
and CG students via the VNOS-E questionnaire 
were evaluated using a descriptive analysis method. 
Research data were analyzed in four stages; data 
coding, identifying themes, defining data, and 
interpreting the findings. Students were coded in 
order to maintain the confidentiality. Students’ 
answers given during the interviews were coded as 
Interview-PR-E-1, Interview-PR-C-l, Interview- 
PO-E-1, and Interview-PO-C-1, and students’ 
answers to the VNOS-E questionnaire were coded 
as VNOS-E-PR-E-1, VNOS-E-PR-C-1, VNOS-E- 
PO-E-1, VNOS-E-PO-C-1. The letters PR and PO 
stands for pre- and post-tests, whereas the letters 
E and C stand for the experimental and control 
groups, respectively. The remaining number shows 
the number of students on the data file. The report 
contains both quotations of students’ answers to the 
VNOS-E questionnaire and interviews. 

Findings 

The following sections report EG and CG students’ 
pre- and post-instruction views of NOS. This section 
consists of a descriptive analysis, statistical results, 
and interpretations for each sub-problem based 
on the study’s findings. The results were examined 
within 5 sub-dimensions: (I) scientific knowledge 
is subject to change, (2) scientific knowledge is 
empirically-based, (3) scientific knowledge is 
subjective, (4) human imagination and creativity 
play an important role in the production of scientific 
knowledge, and (5) observations and inferences are 
different in the production of scientific knowledge. 


Findings of the VNOS-E Questionnaire: 
Experimental and Control Groups’ Pre-test 

The Mann Whitney U-test was applied to the scores 
of the experimental and control groups’ pre-test 
(VNOS-E questionnaire), whose results show there 
to be no statistically significant differences between 
the two groups in four themes of NOS. There was 
seen, however, to exist a significant difference 
between the two groups’ pre-test scores of NOS 
theme: “scientific knowledge is empirically-based” 
( U= 635.500 ,p < .05). Specifically, the experimental 
group students’ scores were lower than those of 
the control group students for this specific NOS 
theme. The U-test results of the groups’ VNOS-E 
questionnaire pre-test scores are given in Table 3. 


Table 3 

The Mann Whitney U-test Results of the Groups’ VNOS-E Ques¬ 
tionnaire Pre-test Scores 


NOS 

Themes 

Group 

N 

Average 

Ranking 

Total 

Ranking 

U 

p* 

NOS-1 

Experi¬ 

mental 

55 

53.75 

2956.50 

1416.500 

.440 


Control 

55 

57.25 

3148.50 



NOS-2 

Experi¬ 

mental 

40 

36.39 

1455.50 

635.500 

.024* 


Control 

42 

46.37 

1947.50 



NOS-3 

Experi¬ 

mental 

38 

37.11 

1410.00 

669.000 

.210 


Control 

41 

42.68 

1750.00 



NOS-4 

Experi¬ 

mental 

55 

57.53 

3164.00 

1401.000 

.388 


Control 

55 

53.47 

2941.00 



NOS-5 

Experi¬ 

mental 

54 

54.98 

2969.00 

1378.000 

.704 


Control 

53 

53.00 

2809.00 




*p < .05. 


The results indicate that the experimental and 
control groups’ students share similar conceptions 
of four of the five NOS themes with only both 
groups’ conception of NOS theme, “Scientific 
knowledge is empirically-based” differing. 


Table 4 
Percentiles 

and Frequency Distribution of th 

e Control Group’s Pre- and Post-test Scores 

according to NOS Themes 



NOS 

Control Group 


Naive 

Has merit 

Informed 


Total 



N 

% 

N 

% 

N 

% 

N 

% 


Pre-test 

4 

7.3 

43 

78.2 

8 

14.5 

55 

100 

NOS-1 


Post-test 

2 

3.6 

51 

91.1 

3 

5.4 

56 

100 


Pre-test 

22 

52.4 

17 

40.5 

3 

7.1 

42 

100 

NOS-2 


Post-test 

23 

53.5 

17 

39.5 

3 

7.0 

43 

100 


Pre-test 

21 

51.2 

19 

46.3 

1 

2.4 

41 

100 

NOS-3 


Post-test 

29 

69.0 

13 

31.0 

0 

0 

42 

100 


Pre-test 

9 

16.4 

36 

65.5 

10 

18.2 

55 

100 

NOS-4 


Post-test 

7 

12.5 

39 

69.6 

10 

17.9 

56 

100 


Pre-test 

25 

47.2 

28 

52.8 

0 

0 

53 

100 

NOS-5 


Post-test 

29 

51.8 

27 

48.2 

0 

0 

56 

100 


801 ^ 












Educational Sciences: Theory & Practice 


The number of students actually included in the 
analysis may be less for some of the NOS themes 
because some responses could not be placed in any 
of the categories for each of the five NOS theme. 
The categories included in each NOS theme are 
summarized below, with prevailing views being 
supported with students’ statements from the 
interview. 

Findings about the Study’s first Research Question 

Descriptive analyses according to the NOS themes 
were performed on the control group’s pre- and 
post-test results. The percentiles and frequency 
distribution of the control group’s pre- and post¬ 
test scores according to the five NOS themes in 
question are given in Table 4. 

The Wilcoxon Signed Ranks Test was performed 
in order to determine whether there existed a 
significant difference between the control group 
students’ views regarding the five NOS themes 
before and after the instruction. According to the 
results of the Wilcoxon Signed Ranks Test, there was 
no statistically significant difference between the 
pre- and post-test scores of control group students’ 
views regarding NOS themes (See Table 5). 


Table 5 

Wilcoxon Signed Ranks Test Results of Control Group’s Pre and 
Post-test Scores about NOS Themes 

NOS 

Post-Pre Test 

n 

Average 

Rank 

Total 

Rank 

z 


Negative Rank 

8 

7.00 

56.00 

.832 

NOS-1 

Positive Rank 

5 

7.00 

35.00 



Same 

42 





Negative Rank 

8 

7.50 

60.00 

.535 

NOS-2 

Positive Rank 

6 

7.50 

45.00 



Same 

25 





Negative Rank 

8 

6.00 

48.00 

1.508 

NOS-3 

Positive Rank 

3 

6.00 

18.00 



Same 

23 





Negative Rank 

7 

8.50 

59.50 

.500 

NOS-4 

Positive Rank 

9 

8.50 

76.50 



Same 

39 





Negative Rank 

8 

8.00 

64.00 

.258 

NOS-5 

Positive Rank 

7 

8.00 

56.00 



Same 

38 





*p < .05. 


Findings of the Control Group Regarding the 
Theme: “Scientific knowledge is reliable but is 
subject to change” 

According to control group students’ pre-test 
results, it has been found that 7% of the students 
held views which were naive, the majority’s (78%) 
had merit, and the remaining 15% held informed 
views on the theme: “scientific knowledge is subject 
to change.” The post-test results for the same group 
of students, however, show that 4% of the students 
held naive views, the majority (91%) held views 
which had merit, and 5% held informed views 
(Table 4). For this theme, both students’ answers 
to questions 1, 3, 4, and 6 on the VNOS-E and 
their answers to the interview questions were 
considered. The review of the control group’s post¬ 
test results revealed that those individuals falling 
into the having merit category stated that scientific 
knowledge might change; however, they could 
not or did not explain reasons for this change. 
The deciding factor for their being placed into the 
having merit category was the fact that they could 
not exemplify this change. One student stated, 
“Science is an evidence-based activity, but it can 
always change ” [VNOS-E-PO-C-8](Q.l). Those 
students who did provide an explanation for change 
usually stated that scientific knowledge may change 
with technological advances and time. 

Findings of the Control Group Regarding 
the NOS theme: “Scientific knowledge is 
empirically-based (based on and/or derived from 
observations of the natural world)” 

Based on the control group students’ pre-test 
results, it was seen the majority (52%) held naive, 
41% had merit, and 7% held informed views on the 
theme: “Scientific knowledge is empirically-based.” 
According to the same groups’ post-test results, it 
was found that 54% held naive, 40% had merit, and 
7% held informed views (Table 4). On reviewing the 
control group’s post-test results, one of the students, 
whose view on this theme was naive, stated, “ Science 
means reaching an objective judgment by examining 
the details of a particular topic ” [VNOS-E-PO-C-56] 
(Q.l) whereas another student said, “ Science creates 
a hypothesis and objective judgments are needed in 
order to validate it. Studies are undertaken to reach 
these objective judgments” [Interview-PO-C-16] 
(Q.l). As can be seen from these examples, students 
consider science to be a compilation of objective 
judgments instead of inferences. 
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Findings of the Control Group Regarding the 
NOS theme: “Scientific Knowledge is Subjective” 

According to the control group students’ pre-test 
results, it was found that the majority (51%) of the 
students held views which were naive, 46% had 
merit, and only 2% held informed views on the 
NOS theme “scientific knowledge is subjective.” 
Regarding the post-test results for the same group, 
the majority (69%) held views, which were naive, 
31% had merit, and none of the students in the 
control group held informed view (Table 4). 
Students’ views on this theme were derived from 
their answers to question 5 in the VNOS-E and 
from the interviews. One of the students holding a 
naive view stated, “They have various ideas because 
they don’t know why they’re dying” [Interview- 
PO-C-2](Q.5), whereas another views supporting it 
was “ Maybe they died immediately, without feeling 
pain from the disease, we can’t know for sure. That 
means scientists all have different information” 
[VNOS-E-PO-C-5](Q.5). Students were placed 
in this category because of their belief that the 
divergence in scientists’ opinions is based on the 
lack of sufficient data and that if there were enough 
data, all scientists would be in agreement. 

Findings of the Control Group Regarding the 
NOS theme: “Human Imagination and Creativity 
play an Important Role in the Production of 
Scientific Knowledge” 

Based on the control group students’ pre-test results, 
it was found that 16% of the students held views 
which were naive, most of them (66%) held views 
which had merit, and 18% held informed views on 
the theme: “human imagination and creativity play 
an important role in the production of scientific 
knowledge.” According to the post-test results of 
the same group, 13% held views which were naive, 


the majority (70%) held views, which had merit, 
and 18% held informed views (Table 4). Students’ 
views were derived from their answers to questions 
4 and 7 on the VNOS-E and from the interviews. 
A review of the control group’s post-test results 
revealed that individuals whose views have merit 
stated that human imagination and creativity had 
an effect on the production of scientific knowledge; 
they could not explain this, which was the reason 
for them to be placed in this category. Students 
expressed that imagination and creativity are used 
during several stages of the scientific knowledge 
production process. One student stated, “ Science 
is what people do using their imagination and 
creativity”[VNOS-E-PO-C-52](Q.l), while another 
stated, “ Science emerged as a result of people’s needs. 
It’s like the integration of nature and man. For me, 
imaginary things are related to imagination. I mean 
we inspire from nature. But we plan them in our 
minds first, or we imagine them. Then we do them. I 
think this is science: The relationship between nature 
and man.” [Interview-PO-C-15](Q.l). 

Findings of the Control Group on the NOS Theme: 
“Observations and Inferences are Different” 

According to the control group’s pre-test results, 
47% of the students held naive views and 33% had 
views which had merit on the theme: “observations 
and inferences are different.” None of the 
participants held an informed view on this theme 
in the control group. According to the post-test 
results for the same group, 52% held naive views, 
48% held views, which had merit, and none held 
informed views (Table 4). Students’ views of this 
theme were derived from their answers to questions 
4 and 6 on the VNOS-E. A review of the control 
group’s post-test results revealed that individuals’ 
views were placed into the naive category because 


Table 6 
Percentiles 

and Frequency Distribution of Experimental Group’s Pre- 

and Post-test Scores 

according to NOS Themes 



NOS 

Experimental Group 


Naive 

Has merit 

Informed 


Total 



N 

% 

N 

% 

N 

% 

N 

% 


Pre-test 

7 

12.7 

41 

74.5 

7 

17.7 

55 

100 

NOS-1 


Post-test 

1 

1.8 

39 

68.4 

17 

29.8 

57 

100 


Pre-test 

31 

77.5 

7 

17.5 

2 

5.0 

40 

100 

NOS-2 


Post-test 

28 

56.0 

16 

32.0 

6 

12.0 

50 

100 


Pre-test 

25 

65.8 

12 

31.6 

1 

2.6 

38 

100 

NOS-3 


Post-test 

17 

32.1 

31 

58.5 

5 

9.4 

53 

100 


Pre-test 

2 

3.6 

45 

81.8 

8 

14.5 

55 

100 

NOS-4 


Post-test 

2 

3.5 

26 

45.6 

29 

50.9 

57 

100 


Pre-test 

24 

44.4 

29 

53.7 

1 

1.9 

54 

100 

NOS-5 


Post-test 

18 

31.6 

37 

64.9 

2 

3.5 

57 

100 
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they expressed no view on observation or inference. 
One student stated, ‘7 believe that the pictures are 
real because they benefited from scientific truths 
while preparing them. In the end, they benefited 
from science. They performed measurements using 
scientific tools [Interview-PO-C-16] (Q.6)” 

Findings about the Study’s Second Research 
Question 

Descriptive analyses about the five NOS themes in 
question were performed on the pre- and post-tests 
results of the experimental group. The percentiles 
and frequency distribution of the experimental 
groups pre- and post-test scores according to NOS 
themes are given in Table 6. 

A Wilcoxon Signed Ranks Test was performed 
to determine whether there existed a significant 
difference on the experimental group students’ views 
on the NOS themes in question before and after the 
instruction. According to the results, a statistically 
significant difference exists for four of the five NOS 
themes (NOS-1 -2-3 and 4) between the experimental 
group students’ pre- and post-test scores. There was 
found to be no statistically significant difference for a 
single theme (NOS-5) (See Table 7). 


Table 7 

Wilcoxon Signed Ranks Test Results of the Experimental 
Groups Pre- and Post-test Scores Regarding NOS Themes 

NOS 

Post-Pre Test 

n 

Average 

Rank 

Total 

Rank 

z 


Negative Rank 

3 

10.50 

31.50 

3.266* 

NOS-1 

Positive Rank 

18 

11.08 

199.50 



Same 

34 





Negative Rank 

2 

6.00 

12.00 

2.696* 

NOS-2 

Positive Rank 

12 

7.75 

93.00 



Same 

26 





Negative Rank 

3 

10.50 

31.50 

3.396* 

NOS-3 

Positive Rank 

19 

11.66 

221.50 



Same 

16 





Negative Rank 

3 

14.00 

42.00 

4.041* 

NOS-4 

Positive Rank 

24 

14.00 

336.00 



Same 

28 





Negative Rank 

6 

10.00 

60.00 

1.606 

NOS-5 

Positive Rank 

13 

10.00 

130.00 



Same 

35 





*p < .05. 


Findings of the Experimental Group on the NOS 
Theme: “Scientific knowledge is reliable but is 
subject to change” 

According to the experimental group students’ pre¬ 
test results, 13% held naive views, the majority (75%) 
held views which had merit, and 18% held informed 
views on the NOS theme: “scientific knowledge is 
subject to change.” The post-test results the same 
group found that 2% of the students held naive 
views, the majority (68%) had merit, and 30% held 
informed views (Table 6). For this theme, students’ 
answers to questions 1, 3, 4, and 6 of the VNOS-E 
and their answers to the interview questions were 
considered. A review of the experimental group’s 
post-test results revealed that individuals’ views 
were placed into the having merit category because 
they stated that scientific knowledge may change, 
but could not explain this change. Students who did 
give an example of how scientific knowledge might 
change usually cited technological advances and 
time for a reason of this change. One student stated, 
“Science makes our lives easier and is constantly 
changing and evolving” [VNOS-E-PO-E-105](Q.l), 
and another stated, “Yes, I think so, because peoples 
thoughts today are different than in the 1980s. Some 
technological devices, such as mobile phones, hadn’t 
been invented yet. Now that they’ve been invented, 
they can be improved” [Interview-PO-E-25](Q.3). 

Findings of the Experimental Group on the NOS 
Theme: “Scientific knowledge is empirically- 
based)” 

Students’ views regarding this theme were derived 
from their answers to question 2 of the VNOS-E 
and from the interviews. Based on the experimental 
group students’ pre-test results, it was found that 
most of the students (78%) held naive views, 18% 
had merit, and 5% held informed views on the NOS 
theme: “Scientific knowledge is empirically-based 
(based on and/or derived from observations of the 
natural world).” According to the post-test results 
for the same, the majority of students (56%) held 
naive views, 32% had merit, and 12% held informed 
views (Table 6). 

Findings of the Experimental Group on the NOS 
Theme: “Scientific Knowledge is Subjective” 

According to the experimental group students’ pre¬ 
test results, it was found that the majority (66%) 
of students held naive views, 32% had merit, and 
only 3% held informed views on the NOS theme: 
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“scientific knowledge is subjective”. Regarding the 
post-test results for the same group, 32% held naive 
views, 59% had merit, and 9% held informed views 
(Table 6). Students’ views on this theme were derived 
from their answers to question 5 on the VNOS-E 
and from the interviews. The views of students who 
expressed that scientist may have different views 
and ideas without giving specific examples of such 
differing a specific example of such differing views 
were coded as “having merit.” 

Findings of the Experimental Group about “Human 
Imagination and Creativity play an Important Role 
in the Production of Scientific Knowledge” 

Based on the experimental group students’ pre-test 
results, it was found that 4% of the students held 
naive views, the majority’s (82%) had merit, and 15% 
held informed views on the NOS theme: “human 
imagination and creativity play an important role in 
the production of scientific knowledge”. According 
to the post-test results for the same group, it has been 
found that 4% held naive views, 46% had merit, and 
the majority (51%) held informed views (Table 6). 
Students’ views were derived from their answers to 
questions 1, 4, and 7 on the VNOS-E and from the 
interviews. A review of the experimental group’s post¬ 
test results revealed that individuals’ views were placed 
into the category “having merit” stated that although 
human imagination and creativity have an effect on 
the production of scientific knowledge, they could 
not explain this. In this category, students stated that 
imagination and creativity are used during particular 
times or stages. One of the answers given to this 
question was, “ They attempt to find and combine the 
fossils. They attempt to make a prediction. They attempt 
to deduce something. They aren’t sure about dinosaurs’ 
exact shape, they make it according to what they see in 
their imagination. By guessing they put the things they 
found together.” [Interview-PO-E-11 ](Q.4). 

Findings of the Experimental Group on the NOS 
Theme “Observations and Inferences are Different” 

According to the experimental group’s pre-test results, 
it was found that 44% of the students held naive 
views, the majority’s (54%) had merit, and 2% held 
informed views on the NOS theme: “observations and 
inferences are different in the construction of scientific 
knowledge.” According to the post-test results for the 
same group of students, it was found that 32% held 
naive views, the majority’s (65%) had merit, and 4% 
held informed views (Table 6). Students’ views for this 


theme were derived from their answers to questions 
4 and 6 on the VNOS-E and from the interviews. A 
review of the experimental group’s post-test results 
revealed that students in the experimental group 
expressed that the results (inferences) obtained by 
scientist from experiments and observations are not 
exact information without being able to give specific 
details. Their views were therefore coded as “having 
merit” category. An example of this may be seen in 
the following student’s statement, “They know it from 
underground fossils and bones. Archaeologists examine 
them, and then interpret them and give them a shape” 
[Interview-PO-E-27](Q.4).” 

Findings about the Study’s Third Research Question 

As discussed earlier, descriptive analyses were 
performed on the results of both the experimental 
and control groups’ pre- and post-test NOS themes. 
The percentiles and frequency distribution of each 
NOS theme are given in Table 4 and 6. A Mann 
Whitney U-Test was performed to determine 
whether there existed a significant difference between 
experimental and control group students’ views on 
NOS themes after the instruction. According to the 
results of the Mann Whitney U-Test, there were 
statistically significant differences for four of the five 
NOS themes (NOS-1-3-4 and 5) between the post¬ 
test scores of the experimental and control group 
students. No statistically significant difference was 
found for one theme (NOS-2) (See Table 8). The 
results suggest that while the percentage of students’ 
views falling into the “informed” category increased 
in experimental group, the percentage of students’ 
views falling into the “naive” and “has merit” 
categories mostly increased in the control group. 


Table 8 

Mann Whitney U-Test Results of Experimental Control Groups 
Post-test Scores about NOS Themes 


NOS 

Group 

n 

Average 

Rank 

Total 

Rank 

U 

NOS-1 

Experimental 

57 

64.09 

3653.00 

1192.000* 

Control 

56 

49.79 

2788.00 


NOS-2 

Experimental 

50 

47.00 

2350.00 

1075.000 

Control 

43 

47.00 

2021.00 


NOS-3 

Experimental 

53 

56.38 

2988.00 

669.000* 

Control 

42 

37.43 

1572.00 


NOS-4 

Experimental 

57 

67.16 

3828.00 

1017.000* 

Control 

56 

46.66 

2613.00 


NOS-5 

Experimental 

Control 

57 

56 

63.13 

50.76 

3598.50 

2842.50 

1246.500* 


*p < .05. 


The control group’s post-test results show that 
the percentages of students’ views falling into the 
“naive” category for the two themes: “Scientific 
knowledge is reliable, but is subject to change 
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(NOS-1)” and “human imagination and creativity 
play an important role in the production of 
scientific knowledge (NOS-4)” decreased whereas 
the percentages of students’ views falling into the 
“naive” category increased for the following three 
themes: “scientific knowledge is empirically-based 
(NOS-2)“scientific knowledge is subjective (NOS- 
3),” and “observations and inferences are different 
on the creation of scientific knowledge (NOS-5)” 
(See Table 4). Regarding the “has merit” category, 
decreases in the percentage of students whose views 
fell into the “has merit” were observed for the NOS-2 
theme whereas an increase in students’ percentages 
was observed for the following four NOS themes: 
NOS-1-3-4-5).” On the other hand, there was found 
to be a slight increase in the percentages of students 
whose views were coded as “informed” for the NOS 
theme: “scientific knowledge is empirically-based 
(NOS-2)” and a decrease in the percentages of 
students whose views were coded as informed for 
the NOS-1-3-4). There was no difference observed 
in NOS-5 theme. 

The experimental group’s post-test results show 
that the percentages of students’ views coded as 
“naive” on the five targeted NOS themes decreased 
(See Table 6). At the same time, the percentages 
of students’ views coded as “informed” on the 
five NOS themes increased. Regarding those 
views which “have merit,” percentages decreased 
for NOS-1 and 5 themes whereas an increase in 
students’ percentages for NOS-2-3 and 4. 

Discussion 

This study aimed to investigate the documentary 
films’ influence on 8 th grade students’ NOS views. 
Regarding students’ views about NOS themes, there 
is no statistically significant difference between 
the control group students’ pre- and post-tests. 
According to these results, it can be concluded 
that although science literacy is underlined in the 
vision statement of Turkey’s science and technology 
curriculum (MEB, 2005), the current instruction 
of cell and force units as recommended by the 
curriculum does not have a significant effect on 
improving students’ views on NOS themes. A 
scientifically literate individual is expected to be able 
to understand and apply NOS themes appropriately; 
namely, by understanding basic science concepts, 
principles, laws, and theories (MEB, 2005, 2013). 
Regarding the science and technology curriculum 
from this perspective, NOS concepts are mentioned 
among curriculum objectives which students are 
expected to acquire. However, the results of this 



study show that the curriculum is not effective in 
presenting NOS themes to students. Findings of 
several other studies in the literature (Erenoglu, 
2010; Kaya, 2011; Metin & Leblebicioglu, 2012) also 
support our findings. 

Regarding students’ views on the five targeted NOS 
themes, while there were found to be statistically 
significant differences between the experimental 
group students’ pre- and post-tests for four of the 
themes (NOS-1-2-3 and 4), no statistically significant 
difference was found for one theme (NOS-5). 

Regarding the post-test results, while there 
were statistically significant differences between 
experimental and control group students’ views 
for four of the five targeted NOS themes (NOS- 
1-3-4 and 5), no statistically significant difference 
was found for one theme (NOS-2). Drawing on 
these results, it has been seen that documentaries 
associated with science topics are effective in 
improving students’ views about most of the NOS 
themes. The documentaries used within the current 
study cover the themes: “Cell Division and Heredity” 
and “Force and Motion” in Turkey’s 8 th grade 
science and technology course. Both preparation 
of similar documentaries for the remaining units 
and the integration of NOS into these units are 
recommended. Turkish science and technology 
curriculum (MEB, 2005) includes objectives related 
to NOS; however, it was seen that the control group 
students’ views did not experience a significant 
improvement as a result of the recommended 
instruction process of the science and technology 
course, indicating that the current curriculum 
is not effective in presenting students the five 
NOS themes in question. Therefore, it seems 
alternative approaches are needed to teach NOS 
to students. The results of the study indicate that 
using documentaries on the curriculum’s cell and 
force units, or at least the specific documentaries 
used in the study, do not have a significant effect 
on improving students’ views on the following NOS 
theme: “Scientific knowledge is empirically-based”. 
Experiments are important in obtaining scientific 
information. In the documentaries that the students 
watched, although students watched scientists 
performing experiments, the documentaries were 
watched in a classroom environment. As such, 
students did not see the execution of the experiment 
first-hand. Since experiments are important in 
obtaining scientific information, NOS themes can 
be supplemented with experiments and presented 
to students in the school’s laboratory. 
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In this study, the VNOS-E questionnaire was used 
to assess students’ views about NOS. In the future, 
studies examining the effects of other NOS themes 
on students’ views for different grade levels by 
using different assessment tools can be conducted. 
In Turkey, within the scope of the FATIH project 
(fatihprojesi.meb.gov.tr) many tablet computers 
have been distributed to students and teachers in 
more than 17 cities and 82 schools. One of the most 
effective places to use visual media is in teaching 
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